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PREFACE 

To improve occupational education- in Illinois public ed ucational agencies, o^ upatinnal 
educators have cooperativelylconducted an Indejiih-anatyslsoT the total occupational prograrrB 
being offered by "local edufcattonjL^^ analysis has been organized as the Three-Phase 

System for State vAdeJEve^mion of Occupational Education Programs. For any evaluation 
activity tobejrf tlsefit is necfessary that the results be disseminated and utilized. Utilization of 
res^jjjs-eanonly be accomplished if data is accepted as the result of impartial and constructive 
a lysis. 



This report presents the conclusion of a year's constructive analysis of the status of 
occupational education in the State of ifonois. In i^-are recommendations and suggested 
solutions for improvement, directed toward Local Education Agencies, State Education 
Agencies, and Universities in the hope that they will be disseminated and acted upon. This 
report was composed by the thirty-six individuals who were responsible for leading the 88 
evaluation teams during the 1974^75 school'year in consortium with the Program Approval and 
Evaluation Unit staff of the Illinois Division of Vocational and Technical EducationNJhe team 
leaders assembled for two days to ^synthesize a collection of data, as well as their own personal 
evaluation experiences into this final produStrtfie" dat^ which was utilized included results of 
questionnaires administered to oyer 8,5'QO students and 2,000 local district personnel, 
information from Local District Onfeand 1 Ffve-Yeaj ^Pfans for Occupational Education, School 
and Community Data Forms, and questionnaires completed by team leaders. * 

\ ; 

The efforts of team leaders, culminating in this report, were to provide a document useful to 
the many agencies striving to improve bccupational education in the State of Illinois. 
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INTRODUCTORY OVERVIEW 

- * ** 

- A-system-tJesigned to evaluate occupational programs throughout Illinois was implemented by ' 

the Division of Vocational and Technical Education during -the-i971"72 school year. The 
. evaluation system, entitled, "The Three-Phase System for Statewide Evaluation of Occupational 
Education Programs", has three major goals: 

1. To promote and assist with the development of quality occupational education 
programs at the locaftevel, 

2. To provide the Division of Vocational and Technical Education with data upon 
which better statewide planning of occupational education programs can be based, 

3. To help ensure accountability of Federal and State funds allocated to local 
occupational education programs. \ 

The Three-Phase Evaluation System for occupational education was field tested at seven sites 
during 1970-71. The 1971-72 evaluations included 70 local educational agencies (LEA's), the 
1972-73 evaluation was expanded to include 116 LEA's and 72 LEA's were evaluated during 
the 1973-74 school year. This report represents the fourth annual summary and synthesis of 
evaluation findings from the Three-Phase Evaluation System. This year's summary, or 
composite, is based upon the evaluation of 88 LEA's wiJhin the state. This 88-agency group 
included 76 secondary agencies (high school and unit districts and area vocational centers) 
seven post-secpndary community colleges and five public (state) agencies. Team consisting of 
educators, business and industrial representatives and students ranged from 4 to 42 members in 
size - involving approximately 900 total team members. 

This composite report is prepared to aid decision makers of LEA's, state agencies and 
institutions of higher education in planning and assessing their efforts. It may be used by these 
agencies to assess statewide needs and to give priority to activities aimed at meeting such needs. 
Also, LEA's can use it as a reference from which to obtain suggestions for improving their 
programs. 

EVALUATION IMPACT 

During the past four years the impact of the Three-Phase evaluations has been assessed by 
several methods. Two studies were done at the University of Illinois - a school foilow-up and an 
impact assessment study - and surveys were conducted by Regional Directors as they reviewed 
Local Plans. After the first year's evaluations, team members were asked to contribute their 
impressions of the system's impact. In all cases it was noted that significant changes and 
Improvements have occurred within LEA's. Frequently cited changes include increased 
participation of educational agencies in joint agreements, addition of staff with administrative 
responsibilities for occupational education, expansion of occupational program offerings to 
students, increased involvement of employers and citizens on advisory committees, establish- 
ment of formal placement services, and initiation of formal student follow-up procedures-just 
1° name a few. All these findings point to the fact that LEA's are utilizing the results of 
evaluations and the suggestions made by visiting evaluation teams. 

The evaluation system has had several indirect, but no less significant impact on Occupational 
Education in Illinois. Possibly one of the most significant outcomes of the system was the 
involvement of people - educators, business representatives and students-in a common effort. 
This common effort was the occasion for in-service education for hundreds of the state's 
educators. Also this involvement provided ^n excellent avenue for dialogue between educators 
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' and community representatives. The statewide composite report generated 5$ a result of the 
. evaluations has been of ^value in its own right. -The Division of Vocational and Technical 
-Slucatjon has utilized the Composite Report to prioritize services and funding of professional 
and curriculum development, research, *nd consultative activities. There has also been a 
unification of efforts made by other state agencies over the past year. This can be attributed, in 1 
part, \o the—identification of statewide needs provided by the ^Composite Report. Many 
universities which offer professional development programs for educators within the state have 
also utilized-the Composite Report. This 4 has been reflected in changes that* have been made in 
teacher, counselor and administrator education programs, many of these address identified state 
needs. 

Each LEA evaluation focused on Eight Areas of Concern for Evaluation. Students Served, 
Occupational Programs, Administrative Organization, Personnel, Objectives, Evaluation, 
Resources Utilized and Guidance Services. These eight areas have also provided the structure for 
this report. Each Area of Concern is divided into three segments: Conclusions, Recommenda- 
tions and Suggested Solutions. Although it is impossible to concisely summarize the entire 
report, general conclusions can be drawn for each Area of Concern as follows: ,J > • • 

1. STUDENTS SERVED 

LoGaJ educational agencies have displayed a variety of ways and delivery systems for meeting 
student needsrThey are to be commended for expanding elementary career and exploration 
programs, sequencing occupational programs (particularly, for providing adult education 
programs), providing viable WECEP programs, identifying handicapped and disadvantaged 
students and modifying programs and methods of meeting individual student needs. Concerns 
in the area of Students Served are the lack of student participation in youth organizations, the 
lack of "college bound" students in. occupational programs, the assessment of students needs 
and interests, student involvement in program planning and evaluation and the provision of 
additional services for handicapped and disadvantaged students. 

2. OCCUPATION/PROGRAMS 

Oner of the most gratifying changes noted in the Occupational Programs area of concern while 
summarizing the 1974-75 evaluation reports was the growing awareness and utilization of joint 
agreements among LEA's, including private agencies. The expansion of services provided to 
students served by occupational programs in Illinois via the joint agreement has resulted in 
better preparation of students served both quantitatively and qualitatively. 

Of greatest concern was the quality of some programs, which, were identified'as providing less 
%than minimal entry-level employment skills. Low quality is not the result of any single factor, 
although two factors were often cited. First was lack of proper prior planning with inadequate 
data upon which *o base decisions. Also, of concern was the pressure placed on LEA's to offer 
programs in all five occupational areas in order to achieve full approval status without respect 
to community needs and employment potential. This issue jnvolved state guidelines and should 
b? reviewed in terms of its effect on occupational programming. 

3. ADMINISTRATIVE ORGANIZATION 



Concerns similar to those included in the FY '74 ^valuation reports; e.g., the need for improved 
communications, a public relations program and job descriptions for the occupational 
adminltfi^tive staff, were expressed again in the FY '75 evaluation reports. As also reported in 
the previoujtear, there continues to be strong administrative support for the local occupational 
programs. Wopking relations of the occupational program staff and administrators was reported 
as good bat it t was, n oted that a need exists for improving or clarifying the" administrative 
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structure. Othpr concerns were the need for long-range* planning and the appointment of 
flu^Jifiedocofpational program directors with adequate time to provide leadership. • 



4. PERSONNEL 



^Occuparionaj^persdnnel recfelve'd high.rafings from both their students and the* members of the 
evaluation teams and, in general, appear to be well-qualified for their positions. However, some 
^Occupational teachers need to obtain additional experience in the world of work in order to 
* meet State standards. * 

5. OBJECTIVES 

The development of measurable objectives has been a major concern of all personnel on the 
local level as evidenced io the "number of districts conducting in-servide workshops and similar 
activities for the development of measurable ^objectives.. The visitation teams listed the * 
continued development and evaluation of the measurable objectives as a high priority in a vasf ~ 
majority of the reports submitted to the local districts. Concern was expressed forthe inc^ased 
utilization of the measurable objectives in the instructional process. The local districts 
expressed confusion over the varying expectations of the state agencies in regard to the writing 
of objectives. 

* . 

6. EVALUATjjQINT ■ . 

Fifteen .percent of LEA's have locally<directed evaluation systems. Evidently/ there is increasing 
concern to evpluate programs and some concern to evaluate program product. Many CEA's 
make* some good use of evaluation, data. LEA's 1 use a great variety of valid and reliable 
evaluative procedures. Evaluatton could be improved by (1) widespread adoption of total 
evaluation schema, (2) pre-service and in-service trajning .about evaluation systems and 
techniques and .(3) implementation of modek systems fo/ program planning.utilizmg evaluative 
and other data inputs. - 

; 

7. RESOURCES UTILIZED 

Occupational educators in local education agencies seem to realize the importance of advisory 
committees in program planning, evaluation and revision but have difficulty in effectively 
utilizing such committees. Often a systematic approach has not been ^cfeveloped for the*' 
utilization of community resources, bottj public and Drivate including persons, equipment and. 
facilities. Further, non-occupational school personnel and students are not fully involved^ri the 
planning and conducting of occupational education. In some instances* also, adequate or 
modern equipment and facilities are no£ provided f6r ina pi erne rtfing occupational education ' 
programs. . / • * 

8. GUIDANCE ' # * " ' « 

The on-site evaluations have had an obviously positive effect on the scope and quality of 1 
guidance services in relationship td the occupational programs in school districts across the 
state. There is evfdence that occupational interests of students are being determined through 
systematic testing services and that occupational information is being accymutated and made 
•available to students; however, these efforts need to be expanded to the point that occupational 
interest information is available to guidance counselors for all students. Perhaps the greatest 
need evidenced by team ey/aluatdrs is for a well-planned, communicated; course of action for 
obtaining student interest arid providing related services to be developedin all school districts. . 

A quality program of guidance services must, be developed by guidance staffs, but must also ' 
include the resources of the entire educatior> / staffs. There is good reason to be optomistip- 
regarding improvement in quality of guidanp^ services if a concerted effort between counselor* 
and classroom teachers continues to be evidenced. „ * 



• * CONCLUSIONS, RECOMMENDATIONS AND StlisQESTEO SOLUTIONS \ 

The fojlowing^ages present Jhe conclusions^ tile 1974-75 evaluations. Recommendations fp& 
improvement of occupational'edifcatipn in £ minois are baseji» upon the evaluations of the 88 
LEA's which represent over ten psrcent^of tfie educatiojiaLagencies which offer occupational 
program* Findmgs-aind je&m f 
• o'f Concern for Evaluation with^ ranking chart fcrecetfihg each section. 1 

Bach evaluation team w&f^pojrisibje, for ranging th^Eight Areas pf Concern in order of the 
;_ , , ne&Jing thr* |^atest -attention within, the UEA. A composite of these rankings waft * 

- - * ^^^ d ^or.the S8^aluated LEA's ar^ispresen'tjsd with>.da<%Area V^bnoern t<5 givt.the, 

'« C^ re . ader an o ve «view .ot the strongest and weakest areVsd^pnce$ in insto^ 

Stataof HlmoJs. 1 ' ' ° • 5 ' ; % A . 

a 9 4 * » s*6ugges^a solffttons within facfi section of tb§ report have! been dVectetJ Jo sever?! audiences. 
\ 4 ' \ s \ 'The* following leg^nrf ^la/jfies abbrevicftigns whicn* are use<J to address' suggested solutions to a , 
t' • ? °* * ■ spScjficaudreoce: * V « t ,/ e i ,« . , ' • . " * 

v " UtA - All local educational agencies infllfinofs' * *\ ° ? e ♦ . 

» r ./ DVTE • Division of Vocation dnd Technical Educatfbn, r , r 

'» , IOE* Illinois Office of Education* * . . *. c » °' 0 

' . \ u * Universities' offering pre-senvice and in-service programs fo^opcupatipnal education 

' - personnel *:'<'* ~ *■ J 



personnel 

- fCCB * lllirfois Community College Board * / , ■ * 4 

^ SESFfc- Superintendent of Educational Service Region * o 

■ , * * v" 

Other abbre^ations^re us&i throughout the'text of the report/Sofne of these are as follows: 
^ PB>- Prejtminary EvaluatfSh Instrument 1 ^ 

V^LQ - Team Leader QuWionnaire * «. c " ■ ** ■ • 

/S & C Data - School and Community Data Form . " 1 * * 

^ / IOCP - lllinois Occupational Curriculum' Project • * ° - * ' . • ( */ i 
/ / * AVC - Area Vocational Center' , * . « " , 

' f» % fr. jl^S,' & lllinois State Employment Service ^ - 

CtTA • Comprefhensive Education Training Act * ° * * 
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TRONGEST . 8 



7% 



1% 





8% 



15% 



21% 



13%,* 




4% 



31% 



MEAN RANK 4.8%" 



Each evaluation team was responsible for ranking the Eight % Areas of Concern to aid in 
identifying those areas needing the greatest cjttentjon within LEA's. The above graph 
illustrates the percentage distribution of those rankings for one^fea of Concern, 
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MEAN RANK 3.8% 

* * * ' 

Each evaluation team was responsible for ranking the Eight Areas of Concern to aid iri 
identifying those areas needing the greatest attention within LEA's, The 'above graph 
illustrates th£ percentage distribution of those rankings for one Area of Concern. 
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Each evaluation team was responsible for ranking the Eight Areas of£of>cern to aid In 
identifying those areas needing the greatest attention within LfAfl The above graph 
illustrates the percentage distribution of those -rankings for on* Area of Concern. 
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MEAN RANK* 7.1% 



Each evaluation team was responsible for ranking the Eight Areas of Concern to aid in 
identifying those areas needing the greatest attention within LEA's. The fabove graph 
illustrates the percentage distribution of those rankings for one Area of Concern*^/ 
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illustrates the percentage distribution of those rankings forgone Area of Concern. 
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Each evaluation team was responsible for ranking the Eight Areas of Concern to aid in 
identifying those areas needing the greatest attention within LEA's.- The above graph 
i illustrates the percentage distribution of those rankings for one Area of Concern. ■ 
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♦5/ MEAN .RANK 4.2% 

Each evaluation team was responsible for ranking the Eight Areas of Concern to aid in 
identifying those areas needing the greatest attention within LEA's. The above graph 
illustrates the percentage distribution of those rankings for one'Arerof Concern. 
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